Hybrid training of optical neural networks

نویسندگان

چکیده

Optical neural networks are emerging as a promising type of machine learning hardware capable energy-efficient, parallel computation. Today’s optical mainly developed to perform inference after in silico training on digital simulators. However, various physical imperfections that cannot be accurately modeled may lead the notorious “reality gap” between simulator and system. To address this challenge, we demonstrate hybrid where weight matrix is trained with neuron activation functions computed optically via forward propagation through network. We examine efficacy three different networks: an linear classifier, opto-electronic network, complex-valued study comparative training, our results show robust against kinds static noise. Our platform-agnostic scheme can applied wide variety networks, work paves way towards advanced all-optical intelligence.

برای دانلود باید عضویت طلایی داشته باشید

برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

Training Neural Networks with GA Hybrid Algorithms

Training neural networks is a complex task of great importance in the supervised learning field of research. In this work we tackle this problem with five algorithms, and try to offer a set of results that could hopefully foster future comparisons by following a kind of standard evaluation of the results (the Prechelt approach). To achieve our goal of studying in the same paper population based...

متن کامل

Hybrid interior point training of modular neural networks

Modular neural networks use a single gating neuron to select the outputs of a collection of agent neurons. Expectation-maximization (EM) algorithms provide one way of training modular neural networks to approximate non-linear functionals. This paper introduces a hybrid interior-point (HIP) algorithm for training modular networks. The HIP algorithm combines an interior-point linear programming (...

متن کامل

Training Artificial Neural Networks by a Hybrid PSO-CS Algorithm

Presenting a satisfactory and efficient training algorithm for artificial neural networks (ANN) has been a challenging task in the supervised learning area. Particle swarm optimization (PSO) is one of the most widely used algorithms due to its simplicity of implementation and fast convergence speed. On the other hand, Cuckoo Search (CS) algorithm has been proven to have a good ability for findi...

متن کامل

Estimation of Industrial Production Costs, Using Regression Analysis, Neural Networks or Hybrid Neural - Regression Method?

Estimation (Forecasting) of industrial production costs is one of the most important factor affecting decisions in the highly competitive markets. Thus, accuracy of the estimation is highly desirable. Hibrid Regression Neural Network is an approach proposed in this paper to obtain better fitness in comparison with Regression Analysis and the Neural Network methods. Comparing the estimated resul...

متن کامل

Training Large Neural Networks

We describe regularization tools for training large-scale artiicial feed-forward neural networks. We propose algorithms that explicitly use a sequence of Tikhonov regularized nonlinear least squares problems. For large-scale problems, methods using new special purpose automatic diierentiation are used in a conjugate gradient method for computing a truncated Gauss-Newton search direction. The al...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

ژورنال

عنوان ژورنال: Optica

سال: 2022

ISSN: ['2334-2536']

DOI: https://doi.org/10.1364/optica.456108